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1.0  INTRODUCTION 


Cross-correlation  calculations  of  signals  received  by  two  different  sensors  can  bfc 
employed  for  estimation  of  position  and  velocity  parameters  of  the  transmitting  source. 

These  same  calculations  can  be  employed  as  a normalized  detection  statistic  through  the 
use  of  coherence  or  regression  of  one  sensor’s  output  with  respect  to  the  other.  Independent 
of  whether  the  calculations  are  primarily  for  estimation  or  detection  purposes,  filtering  ol 
the  received  signals  should  be  conducted  in  a fashion  to  optimize  performance.  If  full 
knowledge  of  the  noise  statistics  exists  for  each  sensor  as  well  as  the  statistics  of  the  received 
signals,  then  the  procedure  for  optimizing*  the  filtering  can  be  found  in  Refs.  1 through  4. 

For  detection  purposes,  the  processor  is  based  upon  the  likelihood  ratio,  which  declares 
a signal  present  if 

P(  X I signal  plus  noise)  > ^,  ^ 

P(  X I noise) 

where  X denotes  the  data  of  observation,  P(XlZ)  denotes  the  probability  of  the  input  data 
occurring  under  hypothesis  Z,  and  T denotes  a threshold  corresponding  to  a particular 
probability  of  false  alarm.  + For  parameter  estimation,  the  processor  is  based  upon  the 
maximum  likelihood  solution 

P(X  I signal  plus  noise)  = 0 (-) 

do 

where  0 is  the  unknown  parameter.  In  situations  where  little  a priori  knowledge  exists 
about  the  noise  and  signal  statistics,  optimization  of  the  processing  is  not  as  straighttorward. 
The  concept  of  a likelihood  ratio  processor  is  still  advantageous,  but  now  sampled  or 
approximated  values  have  to  be  utilized  in  the  likelihood  ratio  instead  ot  true  values.  The 
use  of  sampled  values  in  the  likelihood  ratio  to  describe  unknown  values  can  be  thought  of 
as  single-iteration  adaptive  filtering  of  the  cross-correlation  calculation.  With  two  sensors 
being  involved  in  the  calculations,  the  adaptation  need  not  be  constrained  to  the  individual 
signals  at  each  sensor  but  can  occur  on  the  cross-correlation  or  equivalently,  the  cross-spectrum 
calculated  between  the  sensors.  As  will  be  shown  in  this  report,  adaptation  on  the  cross- 
spectrum by  means  of  a likelihood  expression  provides  a formalism  for  matching  the  process- 
ing bandpass  to  the  bandwidth  of  the  signal  and  for  compensating  for  colored  noise  or 
interference  within  the  processing  bandpass.  One  ot  the  major  advantages  ot  the  adaptation 


‘Optimization  here  refers  to  maximizing  the  probability  of  detection  for  a given  probability  of  false  alarm 
(i.e.,  the  Neyman-Pearson  criteria)  and  providing  minimum  variance  parameter  estimates  (the  asymptotic- 
property  of  maximum  likelihood  estimators). 

■w.J.  Bangs.  "Array  Processing  With  Generalized  Beam-Formers,"  PhJ).  Dissertation,  Yale  University.  New 
Haven.  Connecticut.  September  1971 . 

“C.W.  Helstrom . Statistical  Theory  of  Signal  Detection.  Permagon  Press.  19h8. 

3H.L.  Van  Trees.  Detection.  Estimation,  and  Modulation  Theory.  Pari  I.  John  Wiley  and  Sons.  I9f>8. 

4D.  Middleton.  An  Introduction  to  Statistical  Communication  Theory.  McGraw-Hill.  I‘>60. 

*A  bar  notation  is  used  to  denote  vectors. 
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is  that  no  a priori  assumptions  about  the  nature  of  the  signals  (broadband  or  narrowband) 
or  the  interference  has  to  be  made. 

The  purpose  of  the  work  presented  in  this  report  is  to  present  the  statistics  for 
algorithms  based  on  likelihood  criteria  (likelihood  ratio  or  maximum  likelihood)  that  adapt 
on  the  cross-spectrum  in  order  to  jointly  detect  and  estimate  signal  parameters.  Section  2 
of  the  report  will  discuss  the  algorithms  examined  while  Section  3 will  describe  their 
statistical  properties.  Finally,  Section  4 presents  the  conclusion. 

2.0  LIKELIHOOD  EXPRESSIONS  FOR  CROSS-CORRELATION  PROCESSING 

Two  likelihood-based  algorithms  for  joint  detection  and  estimation  of  signal 
parameters  from  data  at  the  output  of  two  sensors  will  be  considered  in  this  report.  The 
first  is  a generalized  likelihood  ratio  test  statistic,  while  the  other  is  an  approximate  form 
of  a maximum  likelihood  parameter  estimator.  Selection  of  these  two  algorithms  is  based 
on  their  being  likelihood  processors  and  on  their  being  normalized  test  statistics.  A normal- 
ized test  statistic  does  not  depend  upon  absolute  power  levels  received  at  the  sensors.  For 
low-frequency  acoustic  signals,  where  the  noise  background  has  been  shown  to  be  stationary 
for  only  short  time  periods,  this  property  takes  on  added  importance  ( Ref.  5). 

GENERALIZED  LIKELIHOOD  EXPRESSION 

A generalized  likelihood  ratio  test  statistic  is  the  classical  approach  (Refs.  2,  3,  6) 
for  detecting  a signal  when  full  knowledge  about  the  signal  or  noise  properties  is  not 
available.  For  cross-correlation  processing,  these  properties  are  the  signal  time-difference 
between  the  sensors,  the  signal-frequency  difference  between  the  sensors,  the  spectral  level 
of  the  signal  as  a function  of  frequency,  and  the  spectral  level  of  the  noise  as  a function  of 
frequency.  The  test  statistic  has  the  form 

p(zl(? i )(max.  over  ^|) 

NjLR  p(zI?q)  {max.  over  &q}  ^ 

where  p(z|0)  represents  the  conditional  density  of  the  input  data  on  the  parameter  set  9. 

9 j denotes  the  parameter  set  under  condition  of  signal  plus  noise  being  present,  and  0 q 
denotes  the  parameter  set  under  the  condition  of  noise  only  being  present.  The  above  test 
statistic  forms  maximum  likelihood  estimates  for  both  9 ] and  0q  and  substitutes  these 
into  the  likelihood  ratio  as  if  they  were  the  true  values.  The  above  test  statistic  has  been 
derived  for  the  case  where  the  signal  and  noise  are  assumed  to  be  Gaussian  distributed,  but 
their  respective  spectral  levels  as  a function  of  frequency  are  unknown.  Also,  the  signal’s 
time  difference  and  frequency  difference  between  the  sensors  is  assumed  unknown.  The 

^T.  Arase  and  E.  Arase.  "Deep  Sea  Ambient  Noise  Statistics,”  J.  Acoust.  Soc.  Am..  Vol.  44,  pp.  Ih7l)-1684, 
April  1968. 

6D.  Becker,  “Investigate  the  Use  of  Alternate  Sample  Statistics,”  ORINCON  Company  Report,  prepared 
under  Contract  N000123-76-C-0505,  December  1976. 
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derivation  of  the  test  stastic  under  these  conditions  is  discussed  in  Refs.  6 and  7.  A con- 
densed form  of  the  derivation  is  presented  in  Appendix  A and  leads  to* 


Aglr  = Xrf  -7"(wjc)  cos-  | wkT  + \l>  (wk)lj. 


(4) 


Here.  7”(wk)  is  the  sampled  magnitude  squared  coherence  (MSC)  between  the  two  sensors 
at  radian  frequency  wk,  ^(w^).  is  the  sampled  cross-spectral  phase  between  the  two  sensors 
at  radian  frequency  wk,  t is  the  search  parameter  over  the  time  difference  between  the 
sensors,  and  K is  the  set  of  frequencies  over  which  filtering  is  to  be  performed.'  Equation 
(4)  shows  that  a sum  of  information  across  frequency  is  taken,  but  the  summation  posses- 
ses a complicated  dependence  on  the  sampled  cross-spectral  and  auto-spectral  parameters. 
Use  of  Eq.  (4)  does  not  necessarily  guarantee  that  the  two-sensor  probability  of  detection 
will  be  maximized  or  that  minimum  variance  parameter  estimates  will  occur.  The  use  of 
Eq.  (4)  can  only  be  expected  to  provide  nearly  optimum  detection  performance  because 
the  general  concept  of  a likelihood  ratio  processor  has  been  retained.  Also,  since  the 
parameter  estimates  are  maximum  likelihood  estimates,  they  approach  minimum  variance 
estimates  asymptotically  as  a function  ot  observation  time  (Ref.  *•)). 


MAXIMUM  LIKELIHOOD  ESTIMATOR  (APPROXIMATE! 

Since  a generalized  likelihood  ratio  processor  does  not  necessarily  guarantee  optimum 
processing  performance,  it  is  reasonable  to  consider  other  likelihood-based  processing  tech- 
niques. This  consideration  can  be  based  upon  ease  of  implementation  among  other  factors. 
The  maximum  likelihood  estimate  for  the  set  of  signal  parameters  0 \ is  given  by  the 
solution  of 

p(r!5  j Umax,  over  9 1 ). 


In  Eqs.  (3)  and  (4).  it  was  assumed  that  0 | included  the  noise  spectral  levels  as  a function 
of  frequency  and  the  signal  spectral  levels  as  a function  of  frequency.  If  the  signal  and 
noise  spectra)  levels  as  a function  of  frequency  are  known.  Eq.  (5)  leads  to  (Refs.  10.  1 1) 


E7-(wk)  |Gn<wk)l  , : 

7 ~ : c,p(wj  cos|wkr  + *(wk)l 

keK  1 -7"<wk)  ^12,wk'l 


•The  maximization  of  Aqlr  over  the  frequency  difference  between  the  sensors  is  implicit  in  equation  4. 
It  is  further  assumed  that  a narrowband  Doppler  correction  is  sufficient  such  that  the  maximizations  over 
the  Doppler  and  time -difference  parameters  are  asymptotically  independent  of  each  other  (Ref.  8). 

+The  A notation  is  used  to  denote  sampled  parameters  as  opposed  to  tnie  parameters. 

^Reference  available  to  qualified  requesters. 

HP.M.  Schultheiss.  “Estimation  of  Doppler  Shift  and  Differential  Doppler  Shift.”  Yale  University. 
Technical  Report,  prepared  under  Contract  Nbb00l-7b-C-l082,  June  1477. 

4H.  Cramer.  Mathematical  Methods  of  Statistics.  Princeton  University  Press.  I ‘Mb. 

1 Carter.  “Time  Delay  Estimation."  NUSC  TR  5335.  April  \47b. 

G E.  Hannan  and  J.  Thompson.  “Estimating  Ciroup  Delay Hiometrika.  Vol.  bO.  pp.  241-253,  1473. 
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where  72(wk)  represents  the  true  value  of  MSC,  Gj2(Wk)  represents  the  true  cross-spectral 
power,  Gj2(Wjc)  represents  the  sampled  cross-spectral  power,  and  r,  $(wk),  and  K are  as 
defined  earlier.  If  sampled  spectral  properties  are  substituted  for  true  spectral  properties 
in  Eq.  (6),  the  resulting  processor  is  given  by 


aAML  <t)  “ 


y ^ cos  [wkr  + $(wk)] . 

keK  > ~72(wk) 


(7) 


This  relationship  represents  an  inverse  transform  of  the  cross-spectral  phase  with  a weighting 
at  each  frequency  dependent  upon  the  sampled  MSC.  Equation  (7)  possesses  the  following 
properties:  it  represents  a normalized  detection  statistic,  it  is  a zero  mean  test  statistic 
with  noise  only  present  [as  opposed  to  Eq.  (4)],  and  it  can  be  implemented  using  FFT 
processing  techniques.  It  should  be  stated  that  use  of  Eq.  (7)  as  a detection  statistic  was 
not  rigorously  derived. 


LOW  COHERENCE  PROPERTIES  OF  THE  LIKELIHOOD  EXPRESSIONS 


The  form  of  the  generalized  likelihood  ratio  test  stastic  and  the  approximate  maxi- 
mum likelihood  estimator  can  be  examined  for  the  case  of  low  input  coherence  levels.  This 
assumption  simplifies  the  form  of  each  algorithm  such  that  the  difference  between  them 
becomes  more  apparent.  Assuming  low  input  coherence  levels,  the  first-order  terms 
describing  Eqs.  (4)  and  (7)  are 


aGLR  585 

aaml 


7“(wk)  cos2  [wkr  +$(wk)] 
72(wk)  cos  [wkr  +$(wk)]. 


(8) 

(9) 


These  expressions  differ  only  in  the  manner  in  which  the  cross-spectral  phase  is  combined 
across  frequency.  The  weighting  applied  to  each  cross-spectral  phase  measurement  is  identi- 
cal. If  the  cosine  squared  term  of  Eq.  (8)  is  written  in  terms  of  the  twice-angle  formula, 

AGLR^X:  72(wk)+-^-^  72(wk)  cos  [2wkr  + 2&wk)],  (10) 

keK  keK 

the  difference  between  the  two  algorithms  can  also  be  interpreted  in  the  following  sense, 
the  generalized  likelihood  test  statistic  uses  both  a coherent  and  incoherent  summation  of 
information  across  frequency,  and  for  wideband  signals  the  generalized  likelihood  expres- 
sion requires  a higher  degree  of  consistency  in  the  cross-spectral  phase  measurements  across 
frequency. 

Equations  (8)  and  (9)  allow  a simple  interpretation  of  the  manner  in  which  both 
algorithms  act  as  adaptive  filters  on  the  cross  spectrum.  The  contribution  from  each 
frequency  region  does  not  depend  on  absolute  spectral  levels  but  only  upon  the  measured 
coherence  between  the  sensors  at  each  frequency.  If  low  coherence  is  detected  in  particular 
frequency  regions,  those  regions  are  weighted  less  than  other  frequency  regions. 


ENVELOPE  FORM  OF  THE  ALGORITHMS 

The  two  sensor  test  statistics  defined  by  Eqs.  (4)  and  (7)  are  basically  wideband 
processing  algorithms.  Equivalent  performance  on  a narrowband  signal  can  be  obtained, 
with  a large  reduction  in  processing  load,  by  using  envelope  versions  of  these  algorithms. 

The  envelope  expressions  are  straightforward  tor  the  low-coherence  form  ot  both  algorithms 


72<wk)+  II  72(wk)ei«2wk’-  + 2<K>l 


VGLR=>~  ^ 7"(wk)  + 
“ keK 


keK 


AAML=> 


S 72(wk)  eilwkT+^wk)l 

keK 


(11) 

(12) 


but  are  more  difficult  to  write  for  the  exact  expressions.  That  is,  an  explicit  torm  for  the 
envelope  of  A^^l  can  written  as 


AAML~ 


Y 7~(wk)  ei|wkr +i^(wk)] 
keK  1 -72(wk) 


(13) 


but  no  explicit  form  for  the  envelope  of  A(',lR  is  known.  In  order  to  realize  the  envelope 
properties  of  AqLR,  Eq.  (4)  was  sampled  densely  over  one  cycle  of  the  bandpass  center 
frequency  and  the  maximum  value  selected.  This  procedure  was  repeated  at  r intervals 
corresponding  to  the  reciprocal  of  twice  the  processing  bandwidth. 


3.0  STATISTICS  FOR  THE  TWO-SENSOR  LIKELIHOOD  EXPRESSIONS 


In  order  to  effectively  evaluate  the  performance  of  the  likelihood  expressions,  the 
statistics  for  each  expression  must  be  determined.  The  number  ol  summation  terms  across 
frequency  in  these  expressions  in  general  will  not  be  large  enough  to  justify  central  limit 
theorem  approximations.  For  general  use.  the  statistics  ol,  AqlR  an^  AAML  nee^  to 
derived  from  the  joint  probability  distribution  of  7“  and  \J/.  Due  to  the  nonlinear  depen- 
dence of  Eqs.  (4)  and  (7)  with  respect  to  y~  and  $.  exact  determination  of  the  statistics 
for  AglR  and  aAML >s  difficult.  The  low  level  coherence  forms  of  both  algorithms  are 
considerably  simpler  though  and  it  is  generally  the  low  signal-to-noise  ratio  properties  of 
algorithms  that  are  of  the  most  interest.  That  is.  the  probability  of  false  alarm  (Pra* is 
controlled  by  the  zero-coherence  level  properties  and  the  probability  of  detection  (Pj)) 
is  controlled  by  low-level  coherence  except  in  the  region  where  detection  probabilities  are 
approaching  unity. 

In  this  section,  the  statistics  for  the  low-level  coherence  forms  of  Aqlr  and^A^ML 
will  be  developed.  These  statistics  are  governed  by  the  probability  distribution  of  7-(wk) 
and  $(wk)  where  these  random  variables  are  defined  by 


i 


6 


(14) 


N 


A2/  \ 
7 (wk> 


£ F(wk,  n)  H*(wk>  n) 
n=  1 


N 

£ F(wk,  n)  F*(wk,  n) 
n=l 


2 


N 

£ H(wk.  n)  H*(wk,  n) 
n=l 


$(wk)  = arctan 


/■ 

I mag 

< 

’n 

£ F(wk,  n)  H*(wk,  n) 
n=l 

N 

R1 

£ F(wk,  n)  H*(wk,  n) 

V 

|n= 

= 1 J 

A 


> 


> 


(15) 


Here,  F(wk,  n)  denotes  the  Fourier  transform  at  the  n^  time  interval  taken  from  sensor 
one  at  radian  frequency  wk,  and  H(wk,  n)  denotes  the  Fourier  transform  at  the  n^1  time 
interval  taken  from  sensor  two  at  radian  frequency  wk.  If  the  noise  at  each  sensor  is  con- 
strained to  be  jointly  Gaussian  and  independent,  the  signal  is  a Gaussian  random  variable, 
and  the  transforms  in  Eqs.  (14)  and  (15)  are  not  overlapped  in  time,  then  the  joint  proba- 
bility density  function  for  7-  and  $ can  be  obtained  from  Ref.  1 2 


2->N 


,£2  4 | 2 , xn  _ (1  -7") 

P 7 >#l7r  '^’N)  27rr(N)  r(N-l) 


(l-?2)N-2 


^ 2k  I7 1 k r2(N  + k/2) 

k=0  r(k+1) 


_k 

(72)2  cos  ($  - \p)  (16) 

where  T denotes  a gamma  function,  72  and  \p  are  the  true  values  of  MSC  and  cross-spectral 
phase,  and  N is  the  number  of  transforms  used  in  estimating  these  parameters.  It  can  also 
be  shown  that 

P[72(wk),  $(wk),72(wg),  $(wg)]  3=  P(72(wk),  $(wk)]  P(72(wg).  $(w g)]  ( 1 7) 


for  any  value  of  k not  equal  to  t.  This  follows  from  the  fact  that  both  [F(wk,  n),  F(wg,  n)  1 
and  [H(wk,  n),  H(wg,  n)]  are  asymptotically  independent  (Refs.  13,  14,  15)  for  k =/=  C. 
Equations  ( 1 6)  and  ( 1 7)  provide  the  foundation  for  determining  the  statistics  of  the  low- 
coherence  forms  of  Aqlr  and  A^ML-  However,  even  with  this  foundation,  development 
of  analytical  expressions  for  Pp^  and  Pp  which  are  algebraically  tractable  (i.e.,  in  a con- 
venient form  to  use  and  numerically  well-conditioned)  is  difficult.  Consequently,  asymptotic 
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N.  Goodman,  “On  the  Joint  Estimation  of  the  Spectra,  Cospectrum,  and  Quadrature  Spectrum  of  a 
Two-Dimensional  Stationary  Gaussian  Process,”  Scientific  Paper  No.  10.  Engineering  Statistics  Laboratory, 
New  York  University,  March  1957. 

1 1 

V.  MacDonald  and  P.  Schultheiss,  “Optimum  Passive  Bearing  Estimation  in  a Spatially  Incoherent  Noise 
Environment,”/  Acoust.  Soc.  Am.,  vol.  37,  pp.  3743,  December  1968. 

'^W.  Hodgkiss  and  L.  Nolte,  “Covariance  Between  Fourier  Coefficients  Representing  the  Time  Waveforms 
Observed  From  an  Array  of  Sensors,”/  Acoust.  Soc.  Am.,  vol.  59.  pp.  582-590,  March  1976. 

1SM.  Rosenblatt.  Random  Processes.  Springer-Verlag,  1962. 
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series  solutions  for  both  PpA  and  PD  wiI1  be  developed.  The  asymptotic  series  provide 
accurate  expressions  for  PpA  and  Pp.  provided  the  parameter  “N”  in  Eqs.  ( 14)  and  ( 1 5) 
is  large.  Details  of  the  derivation  of  the  series  are  left  for  the  appendices.  Here,  the  general 
technique  employed,  the  resulting  expression,  and  limitations  upon  use  of  the  expression 
will  be  discussed. 


PROBABILITY  OF  FALSE  ALARM 


The  probability  of  false  alarm  expression  is  derived  under  condition  of  noise  only 
present.  Under  this  condition,  Eq.  (16)  reduces  to 


P(^72=O.0,N)  = ^(1-$VK 


(18) 


which  shows  that  the  sampled  values  of  MSC  and  the  cross-spectral  phase  are  statistically 
independent.  The  density  function  of  Eq.  ( 18)  can  be  used  to  derive  the  characteristic 
function  of  7-cos$  and  y~cos~\^  by  one  ot  several  techniques  (Ret.  16).  Denoting  these 
characteristic  functions  as  gAML*^  and  respectively,  the  probability  density 

of  AGLr  and  AamL  can  bc  evaluated  as 


P(AAML  l72  = 0-N-M)  = Tr/  IgAML1101"1  e'UAAMLdu  (,t)) 

~ _ oo 

, 00 

P<aGLR  l72  = °.N,M)  = ^-  f [gGLR(u)lm  eluAGLRdu  (20) 

" *'nn 


where  M is  the  number  of  frequency  regions  or  summation  terms  in  the  likelihood  expres- 
sions. Integrating  the  density  functions  between  a specified  threshold,  T,  and  infinity 
provides  PpA  as  a function  of  T.  The  details  of  these  calculations  are  contained  in 
Appendix  B and  lead  to  the  asymptotic  series  solutions* 


Generalized 
Likelihood  Ratio 


pFA<T)  = 


:n(N-d!  i 


(l;2:N-  I)  Vrr 


M 


NT  - 1.5T)- 


M 

— N 

(N-  1.5)-  (— - 1)! 


1.5 


-1 


(N  - 1.5XM  + 2) 


r<^+  2.  NT  - 1.5T)  + . . . 


(21) 


,(lA.  Papoulis.  Probability,  Random  Variables,  and  Stochastic  Processes,  McGraw-Hill.  1%5. 

♦The  expressions  presented  here  are  applicable  only  when  M is  an  even  integer.  Expressions  for  cases  of 
M as  an  odd  integer  can  be  obtained  from  Appendix  B. 
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Approximated  __ 
Maximum  Likelihood 


FA 


(T) 


->-(k  + 1 / 2) 
M - 1 

(N  - 2)  2 


2~(k  + 1/2) 
M + 3 
(N  - 2)  2 


1.  NT 


" :T) 


(22) 


where  T(,)  denotes  an  incomplete  gamma  function  and  (a;b;c)  denotes  a(a  + b)  (a  + 2b)  . . . 

(a  + cb  - b).  No  simulations  have  been  conducted  to  verity  the  range  ot  parameters  over 
which  the  asymptotic  series  results  are  valid.  It  will  be  stated  only  that  the  series  expressions 
increase  in  accuracy  as  N increases  and  that  breakdown  of  the  series  can  be  expected  when 
the  higher  order  correction  terms  become  as  large  as  the  leading  order  terms  in  an  absolute 
value  sense. 

Plots  of  PfA  as  a function  of  the  specified  threshold  are  presented  in  Fig.  1 for 
M=4  and  N=64.  Similarly,  in  Fig.  2 plots  of  Pra  versus  threshold  are  presented  for  M=4 
and  N=128.  The  low-coherence  form  of  A(^pR  requires  a slightly  larger  threshold  than 
AamL  This  is  reasonable  in  that  both  algorithms  have  very  similar  forms  for  low  input 
coherence  except  for  the  non-zero  mean  of  ApjpR  Both  Pra  expressions  are  also  nearly 
exponential  in  nature  for  N large. 


PROBABILITY  OF  DETECTION 

Probabilities  of  detection  for  the  two  likelihood-based  algorithms  can  be  evaluated 
using  the  same  techniques  as  for  Pra-  except  starting  with  Eq.  (16)  instead  of  Eq.  (18). 

The  same  degree  of  accuracy  in  the  resulting  expressions  need  not  be  required  though.  The 
PpA  expression  depends  upon  the  extreme  tail  of  the  density  functions  such  that  very 
careful  approximations  are  required.  Pq  depends  upon  the  bulk  of  the  density  function 
(if  PD’s  in  the  range  of  0. 1 to  0.9  are  primarily  of  interest)  such  that  coarser  approximations 
can  be  made.  The  fact  that  a coarser  approximation  can  be  made  and  the  fact  that  the 
signal-plus-noise  density  functions  are  more  difficult  to  handle  analytically  motivates  use 
of  a classical  approximation  technique  such  as  an  Edgeworth  series  (Ref.  9).  An  Edgeworth 
series  is  an  asymptotic  series  based  upon  a normal  distribution  and  its  derivatives.  Function- 
ally. the  series  provides  the  probability  density  function  for  a sum  ot  independent  random 
variables  in  terms  of  the  moments  of  the  individual  random  variables.  Therefore,  knowledge 
of  the  moments  of  ■ycostl'p  and  ■y-cos-i/'pcan  be  used  to  directly  determine  the  probability 
density  function  of  A^pR  and  AamL  w*th  signal  plus  noise  being  present.  Integrating  the 
resulting  density  functions  between  a specified  threshold,  T.  and  00  provides  the  probability 
of  detection  as  a function  of  T. 


Details  on  the  derivation  and  convergence  properties  of  an  Edgeworth  series  can  he 
found  in  Refs.  2 and  9.  Here,  only  the  resulting  expression  for  Pp  will  he  presented 


c c C r 

PD(T)  ~ erfc  (z)  + — 1 <t>(2)  (z.)  - (z)  -7T  0<5)(z)  + • . • 

_T-p 


(23) 


where  </>* 11  * denotes  the  n1*7  derivative  of  a normal  density  function,  T denotes  the  selected 
threshold,  Cn  denotes  the  n1*1  cumulant,  n the  mean,  and  o the  standard  deviation,  each  of 
which  are  for  the  M summed  random  variables  defined  in  Eqs.  (8)  and  (9).  Specification 
of  Cn,  n,  and  a in  terms  of  the  moments  of  the  input  random  variables  can  be  found  in 
Chapter  2b  of  Ref  I 7.  Similarly,  specification  of  in  terms  of  Hermite  polynomials 
can  be  found  in  Chapter  12  of  Ref.  9.  The  only  quantities  necessary  to  implement  Eq.  (23) 
are  the  moments  of  7 -cos  $ and  ^-cos-  v ■ These  moments  can  be  computed  directly 
from  Eq.  (1 6)  as 


Generalized  Likelihood  Ratio  Expression: 


m 


J J~  |r“Cos“$  171  p^7",  i^l7-.  i//.  d7  d$ 


(1-y2)  ^ 2k-lr~(N  + k/2)  T (”T+  m +T \ ^k/2 

r(N)r(N-n  h r(k  + l) r(4+m  + 1)  7 


T(N-1) 


1 +(-l) 


k+2m 

r , 


+—  + 1 ; 1 ; N-lj 

Approximated  Maximum  Likelihood  Expression: 
n'm=  J~  J £y  2 cos  P ^2,  $l72.  d>2  d$ 

_ (i^)N-2  - 2k-|r2(N^)i^^4)  ,k/2 

r(N)nN-i)  k^0  m+n  r(-£  + ™ + i) 

r(N-n[i  + (-nk+m] 

(m+*  + I ; 1 ; N - l) 


<7-> 


(24) 


(25) 


(26) 


(27) 


' 7M.  Abramowitz  and  I.  Stcgun,  “Handbook  of  Mathematical  Functions,"  National  Bureau  of  Standards, 
Applied  Mathematic  Series  55,  June  |9f>4. 
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where  denotes  the  m1*1  moment  centered  about  the  origin. 

Equations  (23)  through  (27)  can  be  utilized  to  determine  the  detection  performance 
of  the  low-coherence  forms  of  A^lr  and  A^ml-  Use  Eqs.  (21)  and  (22)  allow  the 
detection  performances  to  be  evaluated  on  the  basis  of  a specified  PpA-  As  a first  illustra- 
tion, the  probability  of  detections  for  A(]LR.  AaML-  an^  a normalized  cross-correlation 
will  be  compared  for  the  situation  of  fiat  signal  and  noise  spectral  properties  across  the  input 
bandpass.  The  probabilities  of  detection  and  false  alarm  for  a normalized  cross-correlation 
can  be  calculated  from  Eqs.  (29.7.1 ) through  (29.7.5)  of  Ref.  9.  The  parameters  selected 
for  the  comparison  are  N=64,  M=4,  and  PpA=IO-^  for  the  likelihood  expressions,  which 
represents  an  equivalent  number  of  degrees  of  freedom  for  the  normalized  cross-correlation 
processor  of  5 1 2.  In  Fig.  3.  the  probabilities  of  detection  as  a function  of  input  signal-to- 
noise  ratio  are  presented  for  all  three  algorithms.  The  normalized  cross  correlation  processor 
shows  an  improvement  of  0.2  and  1 .0  dB.  respectively,  over  A^Ml.  ant*  A()LR  This  result 
is  not  surprising,  the  likelihood  expressions  are  formulated  for  cases  where  the  spectral 
properties  vary  across  the  input  bandpass  and  should  not  be  expected  to  provide  processing 
gain  over  a normalized  cross-correlation  processor  whose  processing  bandwidth  is  matched 
to  the  signal  bandwidth  * 


SIGNAL  TO  NOISE  RATIO.  dB 


Figure  3.  Probability  of  detection  as  a function  of  input  signal  to  noise  rat  ip : Pj.^  = 
IO*-\  flat  input  signal  and  noise  spectra,  5 1 2 degrees  of  freedom. 


*For  flat  spectral  characteristics,  the  likelihood  expressions  can  be  expected  to  provide  degraded  performance 
relative  to  a normalized  cross-correlation  processor  as  the  value  M is  increased.  A simple  proof  of  this  is 
presented  in  Appendix  C. 
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The  primary  benefit  from  the  likelihood  expressions  will  occur  when  the  signal  or 
noise  spectral  levels  vary  as  a function  of  frequency  across  the  input  bandpass.  Under  this 
condition,  the  coherence  weights  estimated  in  each  frequency  interval  will  adapt  to  the 
varying  spectral  properties.  Improvement  over  a normalized  cross-correlation  can  be  illus- 
trated for  the  case  of  the  processing  bandwidth  being  wider  than  the  signal  bandwidth.  A 
mismatched  processing  bandwidth  is  depicted  in  Fig.  4.  The  noise  spectral  density  is  N 
over  the  input  processing  bandwidth,  Bp.  The  signal  spectral  density  is  5 over  the  region 
Bs,  where  Bs  is  less  than  Bp.  For  comparison  purposes  between  A^^l  and  a normalized 
cross-correlation,  let  Pp^  for  each  algorithm  be  set  at  lO-^,  let  A^ML  estimate  coherence 
weights  in  frequency  regions  of  width  Bs,  and  let  the  coherence  weights  be  estimated  with 
64  transform  values  (i.e.,  the  time-bandwidth  product  for  both  processors  is  64  Bp/Bs). 

In  Fig.  5,  the  ratio  of  5/A'  necessary  to  achieve  a Py  of  0.5  is  plotted  as  a function  of  the 
bandwidth  mismatch,  Bp/Bs.  Both  processors  require  nearly  the  same  ratio  of  S/N  with  no 
mismatch.  But  as  the  mismatch  increases,  the  normalized  cross-correlation  requires  vaues 
of  S/N  that  grow  at  a faster  rate.  The  normalized  cross-correlation  requires  a value  of  S/N 
that  increases  by  approximately  1 .5  dB  every  time  the  value  of  Bp/Bs  doubles.  The  likelihood 
expression  requires  a value  of  S/N  that  increased  by  approximately  .75  dB  every  time  the 
value  of  Bp/Bs  doubles.  That  is,  the  likelihood  expression  is  less  subject  to  performance 
degradation  due  to  processing  mismatch  than  a normalized  cross-correlation.  This  same 
conclusion  can  be  drawn  from  examining  the  deflection  ratios  of  each  algorithm  (ratio  of 
mean  output  with  signal  present  to  the  standard  deviation  with  noise  only  present)  as  is 
shown  in  Appendix  C. 

Additional  examples  of  processing  gain  for  the  likelihood  expressions  can  be  illus- 
trated for  the  case  of  colored  noise  or  interference  across  the  input  processing  bandpass. 
Processing  gain  in  these  situations  can  easily  be  expected  because  the  likelihood  expressions 
do  not  depend  upon  absolute  spectral  levels  as  a function  of  frequency  but  only  upon  the 
measured  coherence  as  a function  of  frequency.  Here,  an  example  involving  colored  noise 
will  be  demonstrated  through  the  use  of  an  ambiguity  surface  calculation.  The  expectation 
values  of  the  cross-spectral  properties  selected  for  the  example  are  presented  in  Fig.  6.  The 
noise  power  falls  linearly  over  the  input  processing  bandpass.  A narrowband  signal  is  situated 
in  the  center  of  the  bandpass  and  possesses  a level  corresponding  to  a - 14-dB  signal-to-noise 
ratio  relative  to  the  1 2-Hz  processing  bandpass.  A single  realization  of  these  cross-spectral 
properties  was  created  and  processed  through  the  A^ML  algorithm  and  a normalized  cross- 
correlation.*  The  AaML  algorithm  estimated  coherence  weights  in  1-Hz  regions  across  the 
1 2-Hz  processing  bandpass.  In  Figs.  7 and  8,  ambiguity  surfaces  resulting  from  each  algorithm 
are  presented.  Height  of  the  data  in  the  ambiguity  surface  is  color  encoded,  with  the  highest 
data  point  in  each  surface  represented  by  the  color  red.  The  dimensions  of  the  ambiguity 
surface  are  time-difference  and  Doppler  difference  between  the  two  input  time  series.  The 
position  of  these  parameters  for  the  synthetic  signal  is  denoted  by  the  black  arrows  in 
Fig.  7.  The  ambiguity  surface  created  with  the  A^ml  algorithm  shows  the  highest  peak 
in  the  surface  located  at  the  synthetic  signal's  time  and  frequency  difference  parameters. 

For  the  normalized  cross-correlation  calculation,  the  peak  corresponding  to  the  signal's 


•Envelope  versions  of  each  of  these  algorithms  were  utilized.  The  envelope  of  is  defined  by  Eq.  ( I .t) 

and  the  envelope  of  a normalized  cross-correlation  corresponds  to  estimates  of  magnitude  squared 
coherence. 


SIGNAL  TO  NOISE  RATIO.  dB 


FREQUENCY 


Figure  4.  Depiction  of  processing  mismatch  to  the  signal  bandwidth.  Signal 
possesses  a bandwidth  of  Bs  and  a spectral  density  of  S Processing  bandpass 
is  Bp  with  a noise  spectral  density  of  jV. 


Figure  5.  Signal  to  noise  ratio  necessary  to  obtain  a probability  of  detection  of  0.5  as 
a function  of  the  mismatch  of  processing  bandpass  to  signal  bandpass;  PFA  = 10-3. 
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Figure  tv  Signal  and  noise  cross  spectral  properties  for  the  synthetic  data. 


parameters  is  smaller  than  two  noise  spikes  on  the  surface.  The  data  in  Fig.  7 was  created 
with  a total  time-bandwidth  product  into  each  algorithm  of  1800.  If  the  time-bandwidth 
product  is  decreased  to  1200.  the  ambiguity  surfaces  presented  in  Fig.  8 result.  The  signal 
peak  has  now  essentially  disappeared  from  the  surface  resulting  from  the  normalized  cross- 
correlation.  For  the  surface  generated  with  A^ml-  the  largest  peak  on  the  surface  still 
corresponds  to  the  time  and  frequency  difference  of  the  synthetic  signal. 

4.0  CONCLUSION 

In  this  report,  we  have  demonstrated  that  likelihood-based  filtering  of  the  cross- 
spectrum  can  provide  improved  detection  and  parameter  estimation  performance  over  that 
of  a normalized  cross-correlation  processor.  The  improvement  will  occur  when  the  signal 
and  noise  spectral  properties  vary  over  the  input  bandpass.  Such  a situation  can  be  expected 
when  little  a priori  information  exists  about  the  signal  properties  or  if  the  noise  background 
is  highly  variable,  conditions  which  do  occur  in  low-frequency  acoustic  processing.  There- 
fore, the  likelihood  expressions  represent  a viable  technique  for  conducting  joint  detection 
and  parameter  estimation  on  the  output  of  two  sensors. 

Demonstrations  of  processing  performance  with  the  two  likelihood  expressions 
examined  were  presented  analytically  in  the  form  of  Receiver  Operating  Characteristics 
and  graphically  with  processing  results  on  synthetic  data.  No  major  differences  in  the  per- 
formance between  the  two  algorithms  were  observed.  It  is  felt  that  major  differences  betwee 
the  generalized  likelihood  ratio  expression  and  the  constrained  maximum  likelihood  expres- 
sion will  only  occur  in  the  parameter  estimation  capability  for  wideband  signals.  Analytical 
determination  of  these  differences  may  be  quite  difficult  such  that  the  performance  com- 
parison should  be  conducted  empirically. 
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Figure  7.  Comparative  ambiguity  surfaces  showing  improvement  of  likelihood  ratio  technique 
over  a normalized  cross  correlation,  time-bandwidth  product  of  1800. 


Figure  8.  Comparative  ambiguity  surfaces  showing  improvement  oflikelihood  ratio  technique 
over  a normalized  cross  correlation,  time-bandwidth  product  of  1200. 


Finally,  improvements  upon  the  cross-spectral  filtering  approaches  presented  in  this 
report  may  be  easily  realized.  The  adaptations  analyzed  here  were  single-step  in  nature.  If 
the  signal  and  noise  characteristics  remain  stationary  over  time  periods  longer  than  a single 
observation,  the  coherence  estimates  as  a function  of  frequency  can  be  smoothed  recursively 
in  time.  The  performance  of  the  likelihood  expressions  can  also  be  improved  by  a judicious 
choice  of  the  number  of  frequency  regions  that  coherence  weights  are  estimated  in  across 
the  processing  bandpass.  This  selection  will  be  dependent  upon  coarse  information  concern- 
ing signal  and  noise  properties  for  the  case  of  interest. 
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APPENDIX  A 

GENERALIZED  LIKELIHOOD  RATIO  TEST  STATISTIC 

The  generalized  likelihood  ratio  test  statistic  has  the  form  ( Refs.  3,  4.  (i) 
p(z  15  | ) j max.  over  0 j) 

^GLR  |0q)  jmax.  over  ' 


where  z is  the  vector  of  observation  data  from  two  sensors.  p(zl5)  represents  the  conditional 
density  of  the  input  data  on  the  parameter  set  0,  and  0 j and  9q  denote,  respectively,  the 
parameter  sets  under  condition  of  signal  plus  noise  and  noise  only  being  present.  Without 
loss  of  generality,  the  vector  of  observation  data  can  be  comprised  of  the  Fourier  transform 
of  the  time  series  data  from  each  sensor.  Letting  z denote  the  observation  vector  of  complex 
Fourier  components  and  constraining  both  the  signal  and  noise  to  be  realized  from  a Gaus- 
sian process,  the  probability  density  functions  can  be  written  as 

p(zl<t>)  = 7r“-m  I-’  exp  |-z+4>-’z|  (A-2) 

where  m is  the  size  of  the  vector  of  observation  and  4>  denotes  the  correlation  matrix  under 
the  two  different  hypotheses.  Provided  the  input  spectra  is  well  behaved,  the  above  density 
function  can  be  partitioned  as  (Refs.  10.  13,  14) 


p(z  1 <1>)  = rr'-m 


m 


exp 


( A-3 ) 


whereT^  denotes  the  complex  Fourier  components  for  the  k1*1  frequency  region  and  4^ 
is  the  correlation  matrix  for  the  k1*1  frequency  region  (4>k  is  a two-by-two  dimension). 
Under  condition  of  signal  plus  noise  being  present,  the  partitioned  correlation  matrices 
have  the  form 


‘ 


I 


O]  j (k)  a 1 2(k)  e-'wkT 

o, 2(k)  e‘wkT  °22(k> 


where  aj  i(k),  a22(k),  and  oj  2(k)  are  the  unknown  auto  and  absolute  cross-spectral  levels 
for  the  k1*1  frequency  region,  and  r is  the  signal  travel  time  difference  between  the  sensors. 
Under  condition  of  noise  only  being  present,  the  partitioned  correlation  matrices  have 
the  form 


*k  = 


a , j(k) 
0 


0 

022^ 


Equation  (A-3)  can  also  be  expressed  in  the  form 


(A-5) 


p(zl<i>)  = 7r_2m 


m 

t 


( A-6) 
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where  xk 's  defined  as 

Xk  = Zk?k+  (A-7) 

and  represents  the  sampled  correlation  matrix  for  the  kIh  frequency  region.  If  multiple 
observations  in  time  are  taken,  the  only  change  in  form  for  Eq.  ( A -6)  is  that  the  sampled 
correlation  matrix  is  now  represented  by  the  smoothed  matrix 

xk=i  ik<eirk(C)+  IA-*> 

6=1 

where  denotes  the  Fourier  components  for  the  kth  frequency  region  and  the  6th 
time  period,  and  tt--111  in  equation  (A-6)  is  replaced  by  7r“*-niT.  In  order  to  generate 
aGLR’  e4  (A-6)  needs  to  be  maximized  for  of  the  form  of  Eq.  ( A-4)  and  then  for  <f>k 
of  the  form  of  Eq.  ( A-5). 

SIGNAL  PLUS  NOISE  PRESENT 

The  numerator  of  Eq.  ( A- 1 ) is  obtained  by  solving  the  set  ol  simultaneous  equations 

■—  a—  p(z I4>)  = = — ^ — v p(zl4>)  = ^-rri  p(z|4>)=-^rp(zl4>)  = 0 (A-9) 
9o||(k)  * 9o-»->(k)  ao,2<k>  dr 

for  all  values  of  k where  the  partitioned  correlation  matrices  are  of  the  form  of  Eq.  (A-4). 
Differentiating  Eq.  (A-6)  with  respect  to  o\  j ( k),  and  O]  2<k)  leads  to  the  three 

simultaneous  equations 


xk  V 


r(xk  ^k"1)1 


9a  | | ( k ) 


(Xk  *k) 


9o,  j(k)  ^k 


x ->  ->(  k ) 
a-n(k) 


( A- 10) 


7::<k)  Tr(Xk<I)k)  xn(ki 


9m-)(k) 


a | |(k) 


( A- 1 1 ) 


r , TSTTFl  T'  (*k  '"0  R«[xl2(k)e-iwl‘T 

T' r*i<  V - * — S — — * 1 + Lo,~,m — - «A-|2> 

L J JJTP)  '♦k1 

where  a denotes  adjoint  and  the  x terms  are  elements  of  Xk  The  simultaneous  solutions 
for  oj  i<k),  022<k).  and  o|  2<k)  defined  by  the  above  three  equations  are  found  through 
manipulation  to  be 
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(A-13) 


o i j(k)  - x j | (k) 
o-i->(k)  = x ->  ->(k) 


0|2(k)=R«  x,:(k)  e~iwkr 


(A- 14) 


< A- 15) 


Substituting  these  solutions  back  into  the  numerator  of  Eq.  ( A-l ) provides 

m 

p(zl0j)|max.  over  0|)  = exp  (-2L)  ]^|  |xj  j(k)  x-»-»(k)  — Rt- 

xi2(k)  e ' k J * | max.  over  t|-  (A-lO) 

Although  the  maximization  with  respect  to  r is  easy  to  derive  analytically,  the  form  of 
Eq.  (A-l  6)  turns  out  to  be  more  convenient  for  our  purposes. 

NOISE-ONLY  PRESENT 

The  denominator  of  Eq.  (A-l ) is  obtained  by  solving  the  set  of  simultaneous 
equations 


'doTTTk)  p(7l,p}  = 9^kT',<7)4>)  = 0 


( A- 1 7) 


for  all  values  of  k where  the  partitioned  correlation  matrices  are  of  the  form  of  Eq.  (A-5). 
The  form  of  these  solutions  is  the  same  as  Eqs.  (A- 10)  and  ( A-l  1 ) but  with  <1>|<  defined  by 
Eq.  (A-5).  The  solution  to  these  simultaneous  equations  is  simply  given  by 


o 1 |(k) - X|  j ( k) 
a-»-i(k)  = x-n(k) 


(A-18) 


( A-19) 


Substituting  these  solutions  back  into  the  denominator  of  Eq.  (A-l ) provides 

m 

(max  overdo)  = w“2mLexp  (-2L.)  x,,<k)x22<k)  . (A-2C 


GENERALIZED  LIKELIHOOD  RATIO 


Equations  (A-l 6)  and  (A-20)  can  be  combined  to  form  the  likelihood  ratio  test 


statistic 


x j j ( k ) x -» -*(  k ) 

A(,LR  J=1  x,  ,(k)  Xn(k)  - RC~  /x  n(k)  e"iwkT)  , 

L /-*  (max.  over  r). 


( A-2 1 ) 
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APPENDIX  B 

PROBABILITY  OF  FALSE  ALARM  EXPRESSIONS 

Derivation  of  the  probability  of  false  alarm  for  the  low  level  coherence  forms  of 
Ac.LR  and  A AML  mainly  involves  evaluating  integrals  and  Fourier  transforms.  These 
operations  can  be  found  for  the  most  part  in  standard  references.  Here,  steps  available 
from  standard  references  will  be  denoted  by  the  reference  number  and  the  corresponding 
equation,  both  in  square  brackets. 


APPROXIMATE  MAXIMUM  LIKELIHOOD 


The  noise-only  density  function  for 


'AML 


M A , A M 
' & * 


A 

Zk 


A AT  ^ 
Zk  = COS  0k 


( B-l ) 


can  be  obtained  by  calculating  the  characteristic  function  of  zk,  raising  the  characteristic 
function  to  the  M1*1  power,  and  then  inverting  it.  The  characteristic  function  of  zk  is 
defined  by 


g(u)  = f eil,zk  p(zk)  dzk  (B-2) 

— OO 

where  p(zk)  denotes  the  probability  density  function  ot  zk.  The  characteristic  function  can 
also  be  evaluated  as  (remembering  that  7~k  and  0 k are  statistically  independent  tor  noise 
only  present) 


g< 


u)  = f e'^ic  cos0k  p<7£  ) p(cos0k)  d^  d cos  (?k 


. OO  - OO 


(B-3) 


OO  OO 


= f X eiuxy  p(x)  p(y)  dx  dy  ; x=7j!  and  y=cos  0R.  (B-4) 

_ OO  -Ob 

The  density  functions  for  x and  y are  available  from  (16;  4. 51  and  1 18;  5-1  5 1 such  that 


Jf  J eiuxy  ( l-x)N-“  ( I -y2)  ' 2 dx  dy 


(B-5 » 


where  N is  the  number  of  transforms  utilized  in  estimating  7k  and  0k.  The  term  ( l-x)N 
can  be  written  as 


•*G.  Carter,  “fcstimation  of  the  Magnitude-Squared  Coherence  Function,"  NUSC  TR  4343,  May  l‘>72. 


r oog- 

( 1 -x)^-2  = exp  - (N-2)  £ • 

L c=  1 * 


Substituting  this  series  expression  in  Eq.  (B-5)  and  making  the  change  of  variables 
B=N-2-iuy  and  r=xB  leads  to 


m i N-2-iu  ,B  r^  r - 

<u)  = i^  / / “P  -r-(N-:i  S [u“  + ( B-N+2)- j 

N-2+iu  u 


■dr  dB 


JS-2-iu  rB  _r[  , (N-2)r2  (N-2)r3  , 

J J e - tr3  _ 

i-2+in  0 2B  3B 


f ->1  -Vi 

u2  + (B-N+2)-  dr  dB. 


In  going  from  Eq.  (B-7)  to  (B-8).  the  exponent  terms  for  V>2  have  been  rewritten  in 
individual  Taylor  series  expansions.  The  approximation  that  will  be  employed  for  g(u)  is 
to  change  the  upper  limit  on  the  integration  with  respect  to  r such  that 


N-l  r~2_iu  T r 1 (N-2)r~  <N-2)r3  , 

L,  J e \ 

r , -.i  —Vi 

u- + (B-N+2)-  dr  dB. 


This  approximation  has  been  discussed  in  [ 19;16|  and  has  been  shown  to  be  very  accurate 
for  N large.  Carrying  out  the  integration  with  respect  to  r provides 


g<  u)  = i 


N-l  r~- 
" M-2+i 


N-2-iu 


1 N-2  2(N-2) 


B"  B3 


u-+ (B-N+2)-  dB.  (B-10) 


where  terms  in  the  first  bracket  are  ordered  by  theii  significance  (remembering  that  N is 
restricted  to  be  large  and  that  I B I > N-2).  The  integration  with  respect  to  B can  be  carried 
out  through  the  use  of  120:  2.261. 2.266.  2.269]  and  1 2 1 ; 231.9a]  to  provide 


l^R.  Merk  and  S.  McCarthy,  “Statistics  of  Averaged  Magnitude  Squared  Coherence.”  CMAP  Research 
Report  No.  77-014,  Naval  Ocean  Systems  Center,  April  1078. 

-0|.  Gradshteyn  and  I.  Ry/.hik.  Tables  of  Integral  Series  and  Products.  Academic  Press.  1965. 

2 1 W.  Grobner  and  N.  Hofreiter.  Integraltafel  Enter  Ted  Unbestimmte  Integrate.  Intcgraltafel  Zweiter  Tcil 
Bestimmte  Integrate.  Springer- Verlag,  1966. 
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(B-ll) 


g(u) 


N-l 


_1_  (N-l)  (N-2)  l (N-l ) (N-2)3 

p+(N-2)2]  '/!+  2 pMN-^]3'2'  2 [uG(N-2)2]5/2 


Raising  g(u)  to  the  M*’1  power  and  ordering  terms  by  their  significance  leads  to 


M 

hu) 


(N-l ) 


p + ,N-:,^]M/2  \ 

[u2  + (N-2)2]  + • | • 


l+^(N-2)  u2  + (N-2)2  ' -4m(N-2) 


(B-l  2) 


The  above  characteristic  function  can  be  inverted  through  the  use  of  122;  1.3(7))  to  provide 
the  noise  only  density  function  for  AA^R  °* 


p(AlM.N.7-=0)*  ^ 


1A|(M-1)/2k  _ (N|A|-2IA|)  M 

" +T<N-2) 

(2N-4)(M-D/2r  M 


IA|(M+|  )/c  K(M+1)/2(N|A|-2|A|) 
(2N-4 )<M+l)/2  p(M+  ,) 


(B-l  3) 


where  K denotes  a modified  Bessel  function  of  the  second  kind  and  I’  denotes  a gamma 
function.  Integrating  Lq.  (B-l 3)  between  a specified  threshold,  T,  and  infinity  provides 
the  probability  of  false  alarm  for  Aaml  as  a function  of  T.  The  integration  can  be  per- 
formed in  general  by  expressing  the  Bessel  functions  in  an  infinite  series  expansion.  However, 
for  the  case  of  M being  an  even  integer,  the  modified  Bessel  function  can  be  written  in  terms 
of  a finite  series  expansion  as  shown  in  1 20;  8.468) . Restricting  M to  be  an  even  integer 
and  performing  the  integration  provides 


- - A.  Erdely,  Tables  of  Integral  Transforms.  Volume  I.  McGraw-Hill,  1954. 
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-7— ■- 


I 


-s-k  - Vi 


(N_l  )M  2 ( 2 " * + ^ i-k-Vi  /M  v 

PFA<T>»  -MTJ-  Z ~m  ' 7 , , ^~Wr(--k-NT-2T 

(2N-4)—  r(f)Lk'°  k!lT-'-k)!  (N_2)— 


-T-  (M  + k.) 

+i  y 1- 

■>  4-  . / vi 


->-k  - ‘4 


v-  \ 2 /•  2~K  “ /2  /M  , \ 

£ TTj : r(— -k’+  1.NT-2T  - ...  , (B-14) 

k'=0  k'!(M-k')«  ( \2  ' 


where  T(,)  denotes  an  incomplete  gamma  function  and  where  for  brevity  only  the  first  two 
terms  in  the  asymptotic  series  are  presented.  For  T small,  the  first  term  is  larger  than  the 
second  term  by  approximately  a factor  of  N,  and  higher  order  terms  in  the  series  fall  off  in 
significance  in  terms  of  increasing  powers  of  N.  In  general,  the  first  term  in  Kq.  (B-14)  will 
be  the  dominant  term  provided  N is  large  and  T is  not  allowed  to  become  too  large. 

GENERALIZED  LIKELIHOOD 

The  noise  only  density  function  for 


M . A M . 

At  t 0 A 


. V-  AT  T 2 X-^  C , at  tA 

aGLR  - Z 7k  cos“  ek  = Z hk  : hk  = 7j:  cos"  °k 
k 1 k — 1 


(B-l  5) 


could  be  obtained  by  following  the  same  techniques  as  for  Aaml-  Here  though,  the  proba- 
bility density  function  of  hk  will  first  be  evaluated  directly.  The  probability  density  function 
for  cos-  0k  with  0^  uniformly  distributed  between  -it  and  tt  can  be  evaluated  through  the 
use  of  [ 16;  5-6,  5-7 1 , [23;  p.  232) . and  the  twice  angle  formula  as 

p(y)=-^-<y-yV/j  ; y = cos- 0k.  0 <y  < 1.  (B-16) 

The  probability  density  function  for  7^  can  be  obtained  from  1 1 8;  5-1 5 1 as 

p(x)  = (N-l)(l-x)N“-  ; x = 7£,  0 < x < 1.  (B-l  7) 

The  probability  density  function  forfij.  can  be  evaluated  from  Eq.  (B-16).  Eq.  (B-l  7). 

[16;  7-461 . and  [21 ; 21 2-7al  as 


P(hk>  = < 1“hk> 


N-2 / '~hk  2N  (N-D! 


n ( 1 ; 2;  N-l ) ’ 0<hk<1'  (BI! 


where  (a;b;c)  denotes  a(a+b)  (a+2b) ...  (a+cb-b).  The  characteristic  function  of  h^  is  then 
defined  by 


■ S.  Shelby,  "Standard  Mathematical  Tables."  The  Chemical  Rubber  Company,  1964. 
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g(u)=  / eiuhk  (l-hk)N-2 


, <-hk 

4n  (N—  1 )! 

yj  hk 

T (1:2:  N-l) 

dhk.  (B-19) 


Making  the  change  of  variable  hk  = r~  leads  to 

| LI  ^ 


g(lO  = 


>N 


(N—  1 )! 


J , N-i  . 2 

/ 2(l-r2)  2 eiur  dr. 

0 


7r  (1:2;  N—  1 ) 

Utilizing  the  same  expansion  as  listed  in  Eq.  (B-6)  leads  to 


(B-20) 


g(u)  = 2 


2N  (N-D! 


/ exp 
0 


oo  ->|/ 

— ( N—  1 . 5— iu )r2  — ( N— 1.5)  £ 

k=2  K 


dr.  (B-2 1 ) 


7r  (1:2:  N-l ) 

Making  the  change  of  variable  S = r^N  - 1 .5  - iu  in  Eq.  ( B-2 1 ) and  then  expanding  the 


; to 


g(u) 


2N  (N-l)! 

\/n  - 1.5  - iu 

! (N-l  ,5)S4 

7r  ( 1 ; 2;  N-l ) 

\N-  1 

5 - iu  ^ 

2( N—  1.5  - iu)4 

(N  - 1.5)S6 

- + ... 

dS. 

( B-22) 

3(N  - 1.5  - iu)6 


j 

where  terms  inside  the  brackets  have  been  ordered  according  to  their  significance.  The 
approximation  to  be  employed  on  the  characteristic  function  is  to  change  the  upper  limit 
on  the  integral  to  infinity.  This  is  essentially  the  same  approximation  as  employed  for 
AamL  anc*  requires  N to  be  large  for  a high  degree  of  accuracy  to  occur.  Carrying  out  the 
integration  provides  the  solution 


g(u) 


2n  ( N—  1 )! 


ir  ( 1 : 2;  N-l ) 


[N  - 1.5  - iu  1 ",/2 


N - 1.5 


1 4 

8 (N  - 1 .5  - iu)~ 


5 

IT 


N-1.5 

(N  - 1 .5  - iu)^ 


(B-23) 


The  characteristic  function  can  now  be  raised  to  the  M1*1  power  and  inverted  through  the 
use  of  [22;  3.2.31  in  order  to  obtain  the  noise  only  density  function  for  A(;lr.  To  simplify 
the  form  of  the  solution,  M will  once  again  be  restricted  to  be  an  even  integer.  The  resulting 
solution  for  the  density  function  is 
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r iM  ”-i 

/AIM  M :N  (N~n!  A~  e-(N-l.5)A 

P(AIM.N,7  (1;2;N_nJ  ^_ij! 

3 (N-l .5)  aa  5 (N  — 1.5)  ,3, 

1 ~T  (M'+JT  A~  " (M+2XM+4)  A - - 


(B-24) 


Integrating  the  density  function  provides  the  probability  ot  talse  alarm  expression 


PFA(T) 


-*N  (N—  1 >*  ^ ~ 

mrFPnj  [«N-'-5>-  ,N-” 

nt-ut)*.... 


(N-1.5)2  (N-D!  r^.NT-l.ST) 


(B-25) 


Hquation  (B-25)  possesses  the  same  properties  as  fcq.  (B-I4);  the  first  term  in  the  series  is 
the  dominant  term,  provided  N is  large  and  T is  not  allowed  to  become  too  large. 


APPENDIX  C 
DEFLECTION  RATIOS 


A simple  technique  for  examining  the  detection  capability  of  an  algorithm  is  to 
calculate  its  deflection  ratio:  the  mean  output  with  signal  present  divided  by  the  output 
standard  deviation  with  noise  only  present.  This  ratio  is  a measure  of  the  signal-to-noise 
ratio  at  the  output  of  the  processor.  For  a Gaussian  sample  statistic  at  the  output  of  the 
processor,  the  deflection  ratio  determines  the  Receiver  Operating  Characteristics  of  the 
processor.  For  a non-Gaussian  sample  statistic  at  the  output  of  the  processor,  the  deflec- 
tion ratio  can  only  be  used  as  a measure  of  effectiveness  without  relating  it  directly  to  the 
probability  of  detection.  Here,  the  deflection  ratio  for  the  low  coherence  form  of  AAmj 
and  a normalized  cross-correlation  will  be  examined.  The  standard  deviation  of  Aaml 
with  noise  only  present  can  be  calculated  through  the  use  of  Eq.  (27)  as 


Vm~  _ Vm 

°^N(N+  I)  * N 


(C-l) 


where  M and  N represent  the  number  of  frequency  intervals  and  the  number  of  transforms 
in  each  frequency  region,  respectively.  The  mean  level  with  signal  present  can  also  be 
determined  from  Eq.  (27)  but  the  resulting  series  expression  prevents  simple  analysis. 

The  mean  level  is  approximately  given  by 


M 

M * Y.  TC  . (C-2) 

k=l 

where  the  7j:'s  are  the  true  coherence  levels  in  each  frequency  region.  This  expression  will 
shghtly^underestimate  the  true  mean  by  ignoring  the  bias  present  on  the  sampled  values  of 
7j-  cos  0^.  but  is  sufficient  for  the  purpose  at  hand.  The  deflection  ratio  for  AAML  is 
then  given  by 


M 


The  deflection  ratio  for  a normalized  cross-correlation  processor  needs  to  be  calculated  with 
an  input  of  N X M transforms,  the  same  number  as  input  to  Aaml  The  deflection  ratio 
for  a squared,  normalized  cross-correlation  processor*  can  be  obtained  from  Ref.  18  as 

d.r.(rVNMr  (C-4) 

where  p-  represents  the  magnitude  squared  coherence  across  the  entire  input  bandpass. 
Once  again,  the  bias  on  the  mean  of  p~  is  being  ignored.  If  both  low  input  signal-to-noise 


•Although  a squared  cross-correlation  is  being  utilized  here,  the  comparison  results  are  essentially  indepen- 
dent of  whethei  a cross-correlation  or  a squared  cross-correlation  is  used.  A squared  cross-correlation  is 
being  used  because  its  deflection  ratio  has  the  same  dimensionality  with  respect  to  the  input  signal-to-noise 
ratio  asAAML. 
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ratio  and  equal  signal-to-noise  ratio  at  each  sensor  are  assumed,  Eqs.  (C-3)  and  (04)  can  be 
written  as 


N M /SkY 


(0-5) 


d.r.  (p“)  ~ NMl 


(0-6) 


where  Sj/rij  represents  the  input  signal-to-noise  ratio  across  the  entire  bandpass  and 
Sk/rjk  represents  the  input  signal-to-noise  ratio  in  each  ot  the  M frequency  regions.  Two 
scenarios  will  be  examined  with  the  deflection  ratios,  flat  signal  spectral  levels  across  the 
bandpass  and  the  signal  occupying  only  l/Mth  of  the  input  bandpass.  For  the  case  of  Hat 
spectral  properties  across  the  input  bandpass  and  of  signal-to-noise  ratio  S/17,  the  deflection 
ratios  are  given  by 


(C-7) 


d.r.  (p~) 


(C-8) 


For  the  case  of  the  signal  occupying  only  l/Mth  of  the  input  bandpass  and  with  a signal-to- 
noise  ratio  within  that  region  of  S/17,  the  deflection  ratios  are 


d,  ,AAML»*Ji  (fj  (C'<” 

Equations  (C-7)  through  (C-10)  show  when  processing  gain  can  be  expected  from  the 
likelihood  expression.  For  the  case  of  flat  signal  spectral  properties  across  the  input  band- 
pass, the  deflection  ratio  of  the  likelihood  expression  is  lower  by  a factor  of^M.  For  the 
case  of  the  signal  occupying  only  1 / M**1  of  the  input  bandpass,  the  deflection  ratio  of  the 
likelihood  expression  is  greater  by  a factor  ot^M. 


